SherbyNet - /page/wikibook/entry.mu

Micron Document

<!DOCTYPE html>

<title>Computerized adaptive testing</title>

</head>

Computerized adaptive testing

</h1>

</header>

Computerized adaptive testing (CAT) is a form of <a href="Computer-based_assessment" class="mw-redirect" title="Computer-based assessment">computer-based</a> test that adapts to the examinee's ability level. For this reason, it has also been called tailored testing. In other words, it is a form of computer-administered <a href="Test_(student_assessment)" class="mw-redirect" title="Test (student assessment)">test</a> in which the next item or set of items selected to be administered depends on the correctness of the test taker's responses to the most recent items administered.<a href="#cite_note-1">[1]</a>

<div class="mw-heading mw-heading2"><h2 id="Description">Description</h2></div>

CAT successively selects questions (<a href="Test_item" class="mw-redirect" title="Test item">test items</a>) for the purpose of maximizing the precision of the exam based on what is known about the examinee from previous questions.<a href="#cite_note-WeissKingsbury-2">[2]</a> From the examinee's perspective, the difficulty of the exam seems to tailor itself to their level of ability. For example, if an examinee performs well on an item of intermediate difficulty, they will then be presented with a more difficult question. Or, if they performed poorly, they would be presented with a simpler question. Compared to static tests that nearly everyone has experienced, with a fixed set of items administered to all examinees, computer-adaptive tests require fewer test items to arrive at equally accurate scores.<a href="#cite_note-WeissKingsbury-2">[2]</a>

The basic computer-adaptive testing method is an <a href="Iteration" title="Iteration">iterative</a> <a href="Algorithm" title="Algorithm">algorithm</a> with the following steps:<a href="#cite_note-ThissenMislevy-3">[3]</a>

<ol><li>The pool of available items is searched for the optimal item, based on the current estimate of the examinee's ability</li>

<li>The chosen item is presented to the examinee, who then answers it correctly or incorrectly</li>

<li>The ability estimate is updated, based on all prior answers</li>

<li>Steps 1–3 are repeated until a termination criterion is met</li></ol>

Nothing is known about the examinee prior to the administration of the first item, so the algorithm is generally started by selecting an item of medium, or medium-easy, difficulty as the first item.

As a result of adaptive administration, different examinees receive quite different tests.<a href="#cite_note-Green-4">[4]</a> Although examinees are typically administered different tests, their ability scores are comparable to one another (i.e., as if they had received the same test, as is common in tests designed using classical test theory). The psychometric technology that allows equitable scores to be computed across different sets of items is <a href="Item_response_theory" title="Item response theory">item response theory</a> (IRT). IRT is also the preferred methodology for selecting optimal items which are typically selected on the basis of information rather than difficulty, per se.<a href="#cite_note-ThissenMislevy-3">[3]</a>

A related methodology called <a href="Multistage_testing" title="Multistage testing">multistage testing</a> (MST) or <a href="Computer_adaptive_sequential_testing" class="mw-redirect" title="Computer adaptive sequential testing">CAST</a> is used in the <a href="Uniform_Certified_Public_Accountant_Examination" title="Uniform Certified Public Accountant Examination">Uniform Certified Public Accountant Examination</a>. MST avoids or reduces some of the disadvantages of CAT as described below.<a href="#cite_note-5">[5]</a>

<div class="mw-heading mw-heading2"><h2 id="Examples">Examples</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .ambox{border:1px solid #a2a9b1;border-left:10px solid #36c;background-color:#fbfbfb;box-sizing:border-box}.mw-parser-output .ambox+link+.ambox,.mw-parser-output .ambox+link+style+.ambox,.mw-parser-output .ambox+link+link+.ambox,.mw-parser-output .ambox+.mw-empty-elt+link+.ambox,.mw-parser-output .ambox+.mw-empty-elt+link+style+.ambox,.mw-parser-output .ambox+.mw-empty-elt+link+link+.ambox{margin-top:-1px}html body.mediawiki .mw-parser-output .ambox.mbox-small-left{margin:4px 1em 4px 0;overflow:hidden;width:238px;border-collapse:collapse;font-size:88%;line-height:1.25em}.mw-parser-output .ambox-speedy{border-left:10px solid #b32424;background-color:#fee7e6}.mw-parser-output .ambox-delete{border-left:10px solid #b32424}.mw-parser-output .ambox-content{border-left:10px solid #f28500}.mw-parser-output .ambox-style{border-left:10px solid #fc3}.mw-parser-output .ambox-move{border-left:10px solid #9932cc}.mw-parser-output .ambox-protection{border-left:10px solid #a2a9b1}.mw-parser-output .ambox .mbox-text{border:none;padding:0.25em 0.5em;width:100%}.mw-parser-output .ambox .mbox-image{border:none;padding:2px 0 2px 0.5em;text-align:center}.mw-parser-output .ambox .mbox-imageright{border:none;padding:2px 0.5em 2px 0;text-align:center}.mw-parser-output .ambox .mbox-empty-cell{border:none;padding:0;width:1px}.mw-parser-output .ambox .mbox-image-div{width:52px}@media(min-width:720px){.mw-parser-output .ambox{margin:0 10%}}@media print{body.ns-0 .mw-parser-output .ambox{display:none!important}}

/* end https://en.wikipedia.org/ */

</style>

CAT has existed since the 1970s, and there are now many <a href="Psychological_assessment" class="mw-redirect" title="Psychological assessment">assessments</a> that utilize it.

<ul><li><a href="Graduate_Management_Admission_Test" title="Graduate Management Admission Test">Graduate Management Admission Test</a></li>

<li><a href="SAT" title="SAT">SAT</a> (beginning outside of the US in 2023 and in the US in 2024)<a href="#cite_note-Knox_2024-6">[6]</a></li>

<li><a href="National_Council_Licensure_Examination" title="National Council Licensure Examination">National Council Licensure Examination</a></li>

<li><a href="Armed_Services_Vocational_Aptitude_Battery" title="Armed Services Vocational Aptitude Battery">Armed Services Vocational Aptitude Battery</a></li></ul>

Additionally, a list of active CAT exams is found at International Association for Computerized Adaptive Testing,<a href="#cite_note-7">[7]</a> along with a list of current CAT research programs and a near-inclusive bibliography of all published CAT research.

<div class="mw-heading mw-heading2"><h2 id="Advantages">Advantages</h2></div>

Adaptive tests can provide uniformly precise scores for most test-takers.<a href="#cite_note-ThissenMislevy-3">[3]</a> In contrast, standard fixed tests almost always provide the best precision for test-takers of medium ability and increasingly poorer precision for test-takers with more extreme test scores.

An adaptive test can typically be shortened by 50% and still maintain a higher level of <a href="Accuracy_and_precision" title="Accuracy and precision">precision</a> than a fixed version.<a href="#cite_note-WeissKingsbury-2">[2]</a> This translates into time savings for the test-taker. Test-takers do not waste their time attempting items that are too hard or trivially easy. Additionally, the testing organization benefits from the time savings; the cost of examinee seat time is substantially reduced. However, because the development of a CAT involves much more expense than a standard fixed-form test, a large population is necessary for a CAT testing program to be financially fruitful.

Large target populations can generally be exhibited in scientific and research-based fields. CAT testing in these aspects may be used to catch early onset of disabilities or diseases. The growth of CAT testing in these fields has increased greatly in the past 10 years. Once not accepted in medical facilities and laboratories, CAT testing is now encouraged in the scope of diagnostics.

Like any <a href="Computer-based_testing" class="mw-redirect" title="Computer-based testing">computer-based test</a>, adaptive tests may show results immediately after testing.

Adaptive testing, depending on the item selection <a href="Algorithm" title="Algorithm">algorithm</a>, may reduce exposure of some items because examinees typically receive different sets of items rather than the whole population being administered a single set. However, it may increase the exposure of others (namely the medium or medium/easy items presented to most examinees at the beginning of the test). <a href="#cite_note-ThissenMislevy-3">[3]</a>

<div class="mw-heading mw-heading2"><h2 id="Disadvantages">Disadvantages</h2></div>

The first issue encountered in CAT is the calibration of the item pool. In order to model the characteristics of the items (e.g., to pick the optimal item), all the items of the test must be pre-administered to a sizable sample and then analyzed. To achieve this, new items must be mixed into the operational items of an exam (the responses are recorded but do not contribute to the test-takers' scores), called "pilot testing", "pre-testing", or "seeding".<a href="#cite_note-ThissenMislevy-3">[3]</a> This presents logistical, <a href="Ethical" class="mw-redirect" title="Ethical">ethical</a>, and security issues. For example, it is impossible to field an operational adaptive test with brand-new, unseen items;<a href="#cite_note-WainerMislevy-8">[8]</a> all items must be pretested with a large enough sample to obtain stable item <a href="Statistic" title="Statistic">statistics</a>. This sample may be required to be as large as 1,000 examinees.<a href="#cite_note-WainerMislevy-8">[8]</a> Each program must decide what percentage of the test can reasonably be composed of unscored pilot test items.

Although adaptive tests have exposure control algorithms to prevent overuse of a few items,<a href="#cite_note-ThissenMislevy-3">[3]</a> the exposure conditioned upon ability is often not controlled and can easily become close to 1. That is, it is common for some items to become very common on tests for people of the same ability. This is a serious security concern because groups sharing items may well have a similar functional ability level. In fact, a completely randomized exam is the most secure (but also least efficient).

Review of past items is generally disallowed, as adaptive tests tend to administer easier items after a person answers incorrectly. Supposedly, an astute test-taker could use such clues to detect incorrect answers and correct them. Or, test-takers could be coached to deliberately pick a greater number of wrong answers leading to an increasingly easier test. After tricking the adaptive test into building a maximally easy exam, they could then review the items and answer them correctly—possibly achieving a very high score. Test-takers frequently complain about the inability to review.<a href="#cite_note-9">[9]</a>

Because of the sophistication, the development of a CAT has a number of prerequisites.<a href="#cite_note-10">[10]</a> The large sample sizes (typically hundreds of examinees) required by IRT calibrations must be present. Items must be scorable in real time if a new item is to be selected instantaneously. <a href="Psychometrics" title="Psychometrics">Psychometricians</a> experienced with IRT calibrations and CAT simulation research are necessary to provide <a href="Test_validity" title="Test validity">validity</a> documentation. Finally, a software system capable of true IRT-based CAT must be available.

In a CAT with a time limit it is impossible for the examinee to accurately budget the time they can spend on each test item and to determine if they are on pace to complete a timed test section. Test takers may thus be penalized for spending too much time on a difficult question which is presented early in a section and then failing to complete enough questions to accurately gauge their proficiency in areas which are left untested when time expires.<a href="#cite_note-11">[11]</a> While untimed CATs are excellent tools for <a href="Formative_assessment" title="Formative assessment">formative assessments</a> which guide subsequent instruction, timed CATs are unsuitable for high-stakes <a href="Summative_assessment" title="Summative assessment">summative assessments</a> used to measure aptitude for jobs and educational programs.

<div class="mw-heading mw-heading2"><h2 id="Components">Components</h2></div>

There are five technical components in building a CAT (the following is adapted from Weiss & Kingsbury, 1984<a href="#cite_note-WeissKingsbury-2">[2]</a>). This list does not include practical issues, such as item pretesting or live field release.

<ol><li>Calibrated item pool</li>

<li>Starting point or entry level</li>

<li>Item selection <a href="Algorithm" title="Algorithm">algorithm</a></li>

<li>Scoring procedure</li>

<li>Termination criterion</li></ol>

<div class="mw-heading mw-heading3"><h3 id="Calibrated_item_pool">Calibrated item pool</h3></div>

A pool of items must be available for the CAT to choose from.<a href="#cite_note-WeissKingsbury-2">[2]</a> Such items can be created in the traditional way (i.e., manually) or through <a href="Automatic_item_generation" title="Automatic item generation">automatic item generation</a>. The pool must be calibrated with a psychometric model, which is used as a basis for the remaining four components. Typically, <a href="Item_response_theory" title="Item response theory">item response theory</a> is employed as the psychometric model.<a href="#cite_note-WeissKingsbury-2">[2]</a> One reason item response theory is popular is because it places persons and items on the same metric (denoted by the Greek letter <a href="Theta" title="Theta">theta</a>), which is helpful for issues in item selection (see below).

<div class="mw-heading mw-heading3"><h3 id="Starting_point">Starting point</h3></div>

In CAT, items are selected based on the examinee's performance up to a given point in the test. However, the CAT is obviously not able to make any specific estimate of examinee ability when no items have been administered. So some other initial estimate of examinee ability is necessary. If some previous information regarding the examinee is known, it can be used,<a href="#cite_note-WeissKingsbury-2">[2]</a> but often the CAT just assumes that the examinee is of average ability – hence the first item often being of medium difficulty level.

<div class="mw-heading mw-heading3"><h3 id="Item_selection_algorithm">Item selection algorithm</h3></div>

As mentioned previously, item response theory places examinees and items on the same metric. Therefore, if the CAT has an estimate of examinee ability, it is able to select an item that is most appropriate for that estimate.<a href="#cite_note-WainerMislevy-8">[8]</a> Technically, this is done by selecting the item with the greatest information at that point.<a href="#cite_note-WeissKingsbury-2">[2]</a> <a href="Information" title="Information">Information</a> is a function of the discrimination parameter of the item, as well as the conditional variance and pseudo-guessing parameter (if used).

<div class="mw-heading mw-heading3"><h3 id="Scoring_procedure">Scoring procedure</h3></div>

After an item is administered, the CAT updates its estimate of the examinee's ability level. If the examinee answered the item correctly, the CAT will likely estimate their ability to be somewhat higher, and vice versa. This is done by using the item response function from item response theory to obtain a <a href="Likelihood_function" title="Likelihood function">likelihood function</a> of the examinee's ability. Two methods for this are called <a href="Maximum_likelihood_estimation" title="Maximum likelihood estimation">maximum likelihood estimation</a> and <a href="Bayesian_estimation" class="mw-redirect" title="Bayesian estimation">Bayesian estimation</a>. The latter assumes an a priori distribution of examinee ability, and has two commonly used estimators: expectation a posteriori and maximum a posteriori. <a href="Maximum_likelihood" class="mw-redirect" title="Maximum likelihood">Maximum likelihood</a> is equivalent to a Bayes maximum a posteriori estimate if a uniform (f(x)=1) prior is assumed.<a href="#cite_note-WainerMislevy-8">[8]</a> Maximum likelihood is asymptotically unbiased, but cannot provide a theta estimate for an unmixed (all correct or incorrect) response vector, in which case a Bayesian method may have to be used temporarily.<a href="#cite_note-WeissKingsbury-2">[2]</a>

<div class="mw-heading mw-heading3"><h3 id="Termination_criterion">Termination criterion</h3></div>

The CAT <a href="Algorithm" title="Algorithm">algorithm</a> is designed to repeatedly administer items and update the estimate of examinee ability. This will continue until the item pool is exhausted unless a termination criterion is incorporated into the CAT. Often, the test is terminated when the examinee's standard error of measurement falls below a certain user-specified value, hence the statement above that an advantage is that examinee scores will be uniformly precise or "equiprecise."<a href="#cite_note-WeissKingsbury-2">[2]</a> Other termination criteria exist for different purposes of the test, such as if the test is designed only to determine if the examinee should "Pass" or "Fail" the test, rather than obtaining a precise estimate of their ability.<a href="#cite_note-WeissKingsbury-2">[2]</a><a href="#cite_note-LinSpray2000-12">[12]</a>

<div class="mw-heading mw-heading2"><h2 id="Other_issues">Other issues</h2></div>

In many situations, the purpose of the test is to classify examinees into two or more <a href="Mutually_exclusive" class="mw-redirect" title="Mutually exclusive">mutually exclusive</a> and <a href="Collectively_exhaustive_events" title="Collectively exhaustive events">exhaustive</a> categories. This includes the common "mastery test" where the two classifications are "pass" and "fail", but also includes situations where there are three or more classifications, such as "Insufficient", "Basic", and "Advanced" levels of knowledge or competency. The kind of "item-level adaptive" CAT described in this article is most appropriate for tests that are not "pass/fail" or for pass/fail tests where providing good feedback is extremely important. Some modifications are necessary for a pass/fail CAT, also known as a <a href="Computerized_classification_test" title="Computerized classification test">computerized classification test (CCT)</a>.<a href="#cite_note-LinSpray2000-12">[12]</a> For examinees with true scores very close to the passing score, computerized classification tests will result in long tests while those with true scores far above or below the passing score will have shortest exams.

For example, a new termination criterion and scoring algorithm must be applied that classifies the examinee into a category rather than providing a point estimate of ability. There are two primary methodologies available for this. The more prominent of the two is the <a href="Sequential_probability_ratio_test" title="Sequential probability ratio test">sequential probability ratio test</a> (SPRT).<a href="#cite_note-Wald-13">[13]</a><a href="#cite_note-Reckase-14">[14]</a> This formulates the examinee classification problem as a <a href="Hypothesis_test" class="mw-redirect" title="Hypothesis test">hypothesis test</a> that the examinee's ability is equal to either some specified point above the cutscore or another specified point below the cutscore. Note that this is a point hypothesis formulation rather than a composite hypothesis formulation<a href="#cite_note-Weitzman-15">[15]</a> that is more conceptually appropriate. A composite hypothesis formulation would be that the examinee's ability is in the region above the cutscore or the region below the cutscore.

A <a href="Confidence_interval" title="Confidence interval">confidence interval</a> approach is also used, where after each item is administered, the algorithm determines the probability that the examinee's true-score is above or below the passing score.<a href="#cite_note-KingsburyWeiss-16">[16]</a><a href="#cite_note-EggenStraetmans-17">[17]</a> For example, the algorithm may continue until the 95% <a href="Confidence_interval" title="Confidence interval">confidence interval</a> for the true score no longer contains the passing score. At that point, no further items are needed because the pass-fail decision is already 95% accurate, assuming that the psychometric models underlying the adaptive testing fit the examinee and test. This approach was originally called "adaptive mastery testing"<a href="#cite_note-KingsburyWeiss-16">[16]</a> but it can be applied to non-adaptive item selection and classification situations of two or more cutscores (the typical mastery test has a single cutscore).<a href="#cite_note-EggenStraetmans-17">[17]</a>

As a practical matter, the algorithm is generally programmed to have a minimum and a maximum test length (or a minimum and maximum administration time). Otherwise, it would be possible for an examinee with ability very close to the cutscore to be administered every item in the bank without the algorithm making a decision.

The item selection algorithm utilized depends on the termination criterion. Maximizing information at the cutscore is more appropriate for the SPRT because it maximizes the difference in the probabilities used in the <a href="Likelihood_ratios_in_diagnostic_testing" title="Likelihood ratios in diagnostic testing">likelihood ratio</a>.<a href="#cite_note-SprayReckase-18">[18]</a> Maximizing information at the ability estimate is more appropriate for the confidence interval approach because it minimizes the conditional standard error of measurement, which decreases the width of the confidence interval needed to make a classification.<a href="#cite_note-EggenStraetmans-17">[17]</a>

<div class="mw-heading mw-heading3"><h3 id="Practical_constraints_of_adaptivity">Practical constraints of adaptivity</h3></div>

<a href="Educational_Testing_Service" title="Educational Testing Service">ETS</a> researcher Martha Stocking has quipped that most adaptive tests are actually barely adaptive tests (BATs) because, in practice, many constraints are imposed upon item choice. For example, CAT exams must usually meet content specifications;<a href="#cite_note-ThissenMislevy-3">[3]</a> a verbal exam may need to be composed of equal numbers of analogies, fill-in-the-blank and synonym item types. CATs typically have some form of item exposure constraints,<a href="#cite_note-ThissenMislevy-3">[3]</a> to prevent the most informative items from being over-exposed. Also, on some tests, an attempt is made to balance surface characteristics of the items such as <a href="Gender" title="Gender">gender</a> of the people in the items or the ethnicities implied by their names. Thus CAT exams are frequently constrained in which items it may choose and for some exams the constraints may be substantial and require complex search strategies (e.g., <a href="Linear_programming" title="Linear programming">linear programming</a>) to find suitable items.

A simple method for controlling item exposure is the "randomesque" or <a href="Strata_(statistics)" class="mw-redirect" title="Strata (statistics)">strata</a> method. Rather than selecting the most informative item at each point in the test, the algorithm randomly selects the next item from the next five or ten most informative items. This can be used throughout the test, or only at the beginning.<a href="#cite_note-ThissenMislevy-3">[3]</a> Another method is the Sympson-Hetter method,<a href="#cite_note-SympsonHetter-19">[19]</a> in which a random number is drawn from U(0,1), and compared to a ki parameter determined for each item by the test user. If the random number is greater than ki, the next most informative item is considered.<a href="#cite_note-ThissenMislevy-3">[3]</a>

Wim van der Linden and colleagues<a href="#cite_note-vanderLinden-20">[20]</a> have advanced an alternative approach called shadow testing which involves creating entire shadow tests as part of selecting items. Selecting items from shadow tests helps adaptive tests meet selection criteria by focusing on globally optimal choices (as opposed to choices that are optimal for a given item).

<div class="mw-heading mw-heading3"><h3 id="Multidimensional">Multidimensional</h3></div>

Given a set of items, a multidimensional computer adaptive test (MCAT) selects those items from the bank according to the estimated abilities of the student, resulting in an individualized test. MCATs seek to maximize the test's accuracy, based on multiple simultaneous examination abilities (unlike a computer adaptive test – CAT – which evaluates a single ability) using the sequence of items previously answered (<a href="#CITEREFPiton-GonçalvesAluísio2012">Piton-Gonçalves & Aluísio 2012</a>).

<ul><li><a href="Bayesian_knowledge_tracing" title="Bayesian knowledge tracing">Bayesian knowledge tracing</a></li>

<li><a href="Electronic_assessment" title="Electronic assessment">Electronic assessment</a>, also known as computer-based test – Use of information technology in assessment</li>

<li><a href="Computerized_classification_test" title="Computerized classification test">Computerized classification test</a></li>

<li><a href="Educational_technology" title="Educational technology">Educational technology</a> – Use of technology in education to improve learning and teaching</li>

<li><a href="Linear-on-the-fly_testing" title="Linear-on-the-fly testing">Linear-on-the-fly testing</a></li>

<li><a href="NIH_Toolbox" title="NIH Toolbox">NIH Toolbox</a> – Neurological assessment tool</li>

<li><a href="Active_learning" title="Active learning">Active learning</a></li>

<li><a href="Elo_system" class="mw-redirect" title="Elo system">Elo system</a></li></ul>

<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}

/* end https://en.wikipedia.org/ */

</style><div class="reflist">

/* start https://en.wikipedia.org/ */

.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}

/* end https://en.wikipedia.org/ */

</style><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20170722194028/http://www.ncme.org/ncme/NCME/Resource_Center/Glossary/NCME/Resource_Center/Glossary1.aspx?hkey=4bb87415-44dc-4088-9ed9-e8515326a061#anchorA">"National Council on Measurement in Education"</a>. Archived from <a rel="nofollow" class="external text" href="http://www.ncme.org/ncme/NCME/Resource_Center/Glossary/NCME/Resource_Center/Glossary1.aspx?hkey=4bb87415-44dc-4088-9ed9-e8515326a061#anchorA">the original</a> on 2017-07-22.</cite>

</li>

<li id="cite_note-WeissKingsbury-2">^ <a href="#cite_ref-WeissKingsbury_2-0">a</a> <a href="#cite_ref-WeissKingsbury_2-1">b</a> <a href="#cite_ref-WeissKingsbury_2-2">c</a> <a href="#cite_ref-WeissKingsbury_2-3">d</a> <a href="#cite_ref-WeissKingsbury_2-4">e</a> <a href="#cite_ref-WeissKingsbury_2-5">f</a> <a href="#cite_ref-WeissKingsbury_2-6">g</a> <a href="#cite_ref-WeissKingsbury_2-7">h</a> <a href="#cite_ref-WeissKingsbury_2-8">i</a> <a href="#cite_ref-WeissKingsbury_2-9">j</a> <a href="#cite_ref-WeissKingsbury_2-10">k</a> <cite id="CITEREFWeissKingsbury1984" class="citation journal cs1"><a href="David_J._Weiss" title="David J. Weiss">Weiss, D. J.</a>; Kingsbury, G. G. (1984). "Application of computerized adaptive testing to educational problems". Journal of Educational Measurement. 21 (4): 361–375. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1111%2Fj.1745-3984.1984.tb01040.x">10.1111/j.1745-3984.1984.tb01040.x</a>.</cite>

</li>

<li id="cite_note-ThissenMislevy-3">^ <a href="#cite_ref-ThissenMislevy_3-0">a</a> <a href="#cite_ref-ThissenMislevy_3-1">b</a> <a href="#cite_ref-ThissenMislevy_3-2">c</a> <a href="#cite_ref-ThissenMislevy_3-3">d</a> <a href="#cite_ref-ThissenMislevy_3-4">e</a> <a href="#cite_ref-ThissenMislevy_3-5">f</a> <a href="#cite_ref-ThissenMislevy_3-6">g</a> <a href="#cite_ref-ThissenMislevy_3-7">h</a> <a href="#cite_ref-ThissenMislevy_3-8">i</a> <a href="#cite_ref-ThissenMislevy_3-9">j</a> <cite id="CITEREFThissenMislevy2000" class="citation book cs1">Thissen, D.; Mislevy, R.J. (2000). "Testing Algorithms". In Wainer, H. (ed.). Computerized Adaptive Testing: A Primer. Mahwah, NJ: Lawrence Erlbaum Associates.</cite>

</li>

<li id="cite_note-Green-4"><a href="#cite_ref-Green_4-0">^</a> <cite id="CITEREFGreen2000" class="citation book cs1">Green, B.F. (2000). "System design and operation". In Wainer, H. (ed.). Computerized Adaptive Testing: A Primer. Mahwah, NJ: Lawrence Erlbaum Associates.</cite>

</li>

<li id="cite_note-5"><a href="#cite_ref-5">^</a> See the <cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://www.tandfonline.com/doi/abs/10.1207/s15324818ame1903_1">"2006 special issue of Applied Measurement in Education"</a>.</cite> or <cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://www.routledge.com/Computerized-Multistage-Testing-Theory-and-Applications/Yan-Davier-Lewis/p/book/9781466505773/">"Computerized Multistage Testing"</a>.</cite> for more information on MST.

</li>

<li id="cite_note-Knox_2024-6"><a href="#cite_ref-Knox_2024_6-0">^</a> <cite id="CITEREFKnox2024" class="citation web cs1">Knox, Liam (5 March 2024). <a rel="nofollow" class="external text" href="https://www.insidehighered.com/news/admissions/traditional-age/2024/03/05/college-board-launches-digital-sat">"College Board launches digital SAT"</a>. Inside Higher Ed. Retrieved 10 March 2024.</cite>

</li>

<li id="cite_note-7"><a href="#cite_ref-7">^</a> <cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://www.iacat.org/">"International Association for Computerized Adaptive Testing (IACAT)"</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20091203123321/http://www.iacat.org/">Archived</a> from the original on 2009-12-03.</cite>

</li>

<li id="cite_note-WainerMislevy-8">^ <a href="#cite_ref-WainerMislevy_8-0">a</a> <a href="#cite_ref-WainerMislevy_8-1">b</a> <a href="#cite_ref-WainerMislevy_8-2">c</a> <a href="#cite_ref-WainerMislevy_8-3">d</a> <cite id="CITEREFWainer,_H.Mislevy,_R.J.2000" class="citation book cs1">Wainer, H.; Mislevy, R.J. (2000). "Item response theory, calibration, and estimation". In Wainer, H. (ed.). Computerized Adaptive Testing: A Primer. Mahwah, NJ: Lawrence Erlbaum Associates.</cite>

</li>

<li id="cite_note-9"><a href="#cite_ref-9">^</a> <cite id="CITEREFLawrence_M._Rudner" class="citation web cs1">Lawrence M. Rudner. <a rel="nofollow" class="external text" href="http://edres.org/scripts/cat/catdemo.htm">"An On-line, Interactive, Computer Adaptive Testing Tutorial"</a>. EdRes.org/scripts/cat.</cite>

</li>

<li id="cite_note-10"><a href="#cite_ref-10">^</a> <cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20120425152205/http://www.fasttestweb.com/ftw-docs/CAT_Requirements.pdf">"Requirements of Computerized Adaptive Testing"</a> (PDF). FastTEST Web. Archived from <a rel="nofollow" class="external text" href="http://www.fasttestweb.com/ftw-docs/CAT_Requirements.pdf">the original</a> (PDF) on April 25, 2012.</cite>

</li>

<li id="cite_note-11"><a href="#cite_ref-11">^</a> <cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20130406004757/http://www.businessweek.com/articles/2013-04-03/gmat-tip-adapting-to-a-computer-adaptive-test">"GMAT Tip: Adapting to a Computer-Adaptive Test"</a>. Bloomberg. April 3, 2013. Archived from <a rel="nofollow" class="external text" href="http://www.businessweek.com/articles/2013-04-03/gmat-tip-adapting-to-a-computer-adaptive-test">the original</a> on April 6, 2013.</cite>

</li>

<li id="cite_note-LinSpray2000-12">^ <a href="#cite_ref-LinSpray2000_12-0">a</a> <a href="#cite_ref-LinSpray2000_12-1">b</a> <cite id="CITEREFLinSpray2000" class="citation cs2">Lin, C.-J.; Spray, J.A. (2000), <a rel="nofollow" class="external text" href="https://files.eric.ed.gov/fulltext/ED445066.pdf">Effects of item-selection criteria on classification testing with the sequential probability ratio test. (Research Report 2000-8)</a> (PDF), Iowa City, IA: ACT, Inc., <a rel="nofollow" class="external text" href="https://web.archive.org/web/20150421105738/https://files.eric.ed.gov/fulltext/ED445066.pdf">archived</a> (PDF) from the original on 21 April 2015</cite>

</li>

<li id="cite_note-Wald-13"><a href="#cite_ref-Wald_13-0">^</a> <cite id="CITEREFWald1947" class="citation book cs1">Wald, A. (1947). <a rel="nofollow" class="external text" href="https://archive.org/details/in.ernet.dli.2015.90255">Sequential analysis</a>. New York: Wiley.</cite>

</li>

<li id="cite_note-Reckase-14"><a href="#cite_ref-Reckase_14-0">^</a> <cite id="CITEREFReckase1983" class="citation book cs1">Reckase, M. D. (1983). "A procedure for decision making using tailored testing". In Weiss, D. J. (ed.). <a rel="nofollow" class="external text" href="https://archive.org/details/newhorizonsintes0000unse">New horizons in testing: Latent trait theory and computerized adaptive testing</a>. New York: Academic Press. pp. <a rel="nofollow" class="external text" href="https://archive.org/details/newhorizonsintes0000unse/page/n260">237</a>–255. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0-12-742780-5</bdi>.</cite>

</li>

<li id="cite_note-Weitzman-15"><a href="#cite_ref-Weitzman_15-0">^</a> <cite id="CITEREFWeitzman1982" class="citation journal cs1">Weitzman, R. A. (1982). "Sequential testing for selection". Applied Psychological Measurement. 6 (3): 337–351. <a href="CiteSeerX_(identifier)" class="mw-redirect" title="CiteSeerX (identifier)">CiteSeerX</a> <a rel="nofollow" class="external text" href="https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.1030.6828">10.1.1.1030.6828</a>. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1177%2F014662168200600310">10.1177/014662168200600310</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:122365749">122365749</a>.</cite>

</li>

<li id="cite_note-KingsburyWeiss-16">^ <a href="#cite_ref-KingsburyWeiss_16-0">a</a> <a href="#cite_ref-KingsburyWeiss_16-1">b</a> <cite id="CITEREFKingsburyWeiss1983" class="citation book cs1">Kingsbury, G. G.; Weiss, D. J. (1983). "A procedure for decision making using tailored testing". In Weiss, D. J. (ed.). <a rel="nofollow" class="external text" href="https://archive.org/details/newhorizonsintes0000unse">A comparison of IRT-based adaptive mastery testing and a sequential mastery testing procedure</a>. New York: Academic Press. pp. <a rel="nofollow" class="external text" href="https://archive.org/details/newhorizonsintes0000unse/page/n280">257</a>–283. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0-12-742780-5</bdi>.</cite>

</li>

<li id="cite_note-EggenStraetmans-17">^ <a href="#cite_ref-EggenStraetmans_17-0">a</a> <a href="#cite_ref-EggenStraetmans_17-1">b</a> <a href="#cite_ref-EggenStraetmans_17-2">c</a> <cite id="CITEREFEggenStraetmans2000" class="citation journal cs1">Eggen, T. J. H. M; Straetmans, G. J. J. M. (2000). "Computerized adaptive testing for classifying examinees into three categories". Educational and Psychological Measurement. 60 (5): 713–734. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1177%2F00131640021970862">10.1177/00131640021970862</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:64632296">64632296</a>.</cite>

</li>

<li id="cite_note-SprayReckase-18"><a href="#cite_ref-SprayReckase_18-0">^</a> <cite id="CITEREFSprayReckase1994" class="citation conference cs1">Spray, J. A.; Reckase, M. D. (5–7 April 1994). <a rel="nofollow" class="external text" href="https://files.eric.ed.gov/fulltext/ED372078.pdf">The selection of test items for decision making with a computerized adaptive test</a> (PDF). Annual Meeting of the National Council for Measurement in Education. New Orleans, LA. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20150430165629/https://files.eric.ed.gov/fulltext/ED372078.pdf">Archived</a> (PDF) from the original on 30 April 2015.</cite>

</li>

<li id="cite_note-SympsonHetter-19"><a href="#cite_ref-SympsonHetter_19-0">^</a> <cite id="CITEREFSympsonHetter1985" class="citation conference cs1">Sympson, B.J.; Hetter, R.D. (1985). Controlling item-exposure rates in computerized adaptive testing. Annual conference of the Military Testing Association. San Diego.</cite>

</li>

<li id="cite_note-vanderLinden-20"><a href="#cite_ref-vanderLinden_20-0">^</a> <cite id="CITEREFvan_der_LindenVeldkamp2004" class="citation journal cs1">van der Linden, W. J.; Veldkamp, B. P. (2004). <a rel="nofollow" class="external text" href="https://research.utwente.nl/en/publications/constraining-item-exposure-in-computerized-adaptive-testing-with-shadow-tests(2a8d1a25-43fd-4d2b-8cc3-47dbefed16b4).html">"Constraining item exposure in computerized adaptive testing with shadow tests"</a>. Journal of Educational and Behavioral Statistics. 29 (3): 273–291. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.3102%2F10769986029003273">10.3102/10769986029003273</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:381707">381707</a>.</cite>

</li>

</ol></div></div>

<div class="mw-heading mw-heading3"><h3 id="Additional_sources">Additional sources</h3></div>

<ul><li><cite id="CITEREFDrasgowOlson-Buchanan1999" class="citation book cs1">Drasgow, F.; Olson-Buchanan, J. B., eds. (1999). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=54p5AgAAQBAJ&q=%22adaptive+testing%22">Innovations in computerized assessment</a>. Hillsdale, NJ: Erlbaum.</cite></li>

<li><cite id="CITEREFPiton-GonçalvesAluísio2015" class="citation journal cs1">Piton-Gonçalves, J.; Aluísio, S. M. (2015). <a rel="nofollow" class="external text" href="https://doi.org/10.1590%2FS0104-40362015000100016">"Teste Adaptativo Computadorizado Multidimensional com propósitos educacionais: princípios e métodos"</a>. Ensaio: Avaliação e Políticas Públicas em Educação. 23 (87): 389–414. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1590%2FS0104-40362015000100016">10.1590/S0104-40362015000100016</a>.</cite></li>

<li><cite id="CITEREFPiton-GonçalvesAluísio2012" class="citation conference cs1">Piton-Gonçalves, J.; Aluísio, S. M. (2012). An architecture for multidimensional computer adaptive test with educational purposes. New York, NY, USA: ACM. pp. 17–24. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F2382636.2382644">10.1145/2382636.2382644</a>.</cite></li>

<li><cite id="CITEREFPiton-Gonçalves2020" class="citation journal cs1 cs1-prop-foreign-lang-source">Piton-Gonçalves, J. (2020). <a rel="nofollow" class="external text" href="https://doi.org/10.22347%2F2175-2753v12i36.2735">"Testes adaptativos para o Enade: uma aplicação metodológica"</a>. Meta: Avaliação (in Portuguese). 12 (36): 665–688. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.22347%2F2175-2753v12i36.2735">10.22347/2175-2753v12i36.2735</a>.</cite></li>

<li><cite id="CITEREFVan_der_LindenGlas2000" class="citation book cs1">Van der Linden, W. J.; Glas, C.A.W., eds. (2000). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=7V8KBwAAQBAJ">Computerized adaptive testing: Theory and practice</a>. Boston, MA: Kluwer.</cite></li>

<li><cite id="CITEREFWainer2000" class="citation book cs1"><a href="Howard_Wainer" title="Howard Wainer">Wainer, H.</a>, ed. (2000). Computerized adaptive testing: A Primer (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.</cite></li>

<li><cite id="CITEREFWeiss1983" class="citation book cs1">Weiss, D.J., ed. (1983). New horizons in testing: Latent trait theory and computerized adaptive testing. New York: Academic Press. pp. 237–254.</cite></li></ul>

<div class="mw-heading mw-heading2"><h2 id="Further_reading">Further reading</h2></div>

<ul><li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://iacat.org/node/442">"First Adaptive Test: Binet's IQ Test"</a>. International Association for Computerized Adaptive Testing (IACAT).</cite></li>

<li><cite class="citation conference cs1"><a rel="nofollow" class="external text" href="http://www.sciencedirect.com/science/article/pii/S1877050915003245">Adaptive Testing and Performance Analysis</a>. Procedia Computer Science, International Conference on Advanced Computing Technologies and Applications (ICACTA).</cite></li>

<li><cite id="CITEREFSandsWatersMcBride1997" class="citation book cs1">Sands, William A.; Waters, Brian K.; McBride, James R., eds. (1997). <a rel="nofollow" class="external text" href="https://archive.org/details/DTIC_ADA359337">Computerized adaptive testing: From inquiry to operation</a>. Washington, DC, US: American Psychological Association. pp. xvii 292. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1037%2F10244-000">10.1037/10244-000</a>.</cite></li>

<li><cite id="CITEREFZara1999" class="citation journal cs1">Zara, Anthony R (1999). "Using Computerized Adaptive Testing to Evaluate Nurse Competence for Licensure: Some History and Forward Look". Advances in Health Sciences Education. 4 (1): 39–48. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1023%2FA%3A1009866321381">10.1023/A:1009866321381</a>. <a href="PMID_(identifier)" class="mw-redirect" title="PMID (identifier)">PMID</a> <a rel="nofollow" class="external text" href="https://pubmed.ncbi.nlm.nih.gov/12386434">12386434</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:27771858">27771858</a>.</cite></li></ul>

<div class="mw-heading mw-heading2"><h2 id="External_links">External links</h2></div>

<ul><li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://www.iacat.org">"International Association for Computerized Adaptive Testing"</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20091203123321/http://www.iacat.org/">Archived</a> from the original on 2009-12-03.</cite></li>

<li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://www.psychometrics.cam.ac.uk/newconcerto">"Concerto: Open-source CAT Platform"</a>. University of Cambridge.</cite></li>

<li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://assess.com/fasttest/">"FastTest: CAT platform with free version available"</a>. ASC.</cite></li>

<li><cite id="CITEREFWeiss" class="citation web cs1">Weiss, David J. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20060711174833/http://www.psych.umn.edu/psylabs/catcentral/">"CAT Central"</a>. University of Minnesota. Archived from <a rel="nofollow" class="external text" href="http://www.psych.umn.edu/psylabs/catcentral/">the original</a> on 11 July 2006.</cite></li>

<li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://www.carla.umn.edu/assessment/CATfaq.html">"Frequently Asked Questions about Computer-Adaptive Testing (CAT)"</a>. University of Minnesota. Retrieved 15 April 2005.</cite></li>

<li><cite id="CITEREFRudner1998" class="citation web cs1">Rudner, Lawrence L. (November 1998). <a rel="nofollow" class="external text" href="https://web.archive.org/web/20050611012852/http://edres.org/scripts/cat/catdemo.htm">"An On-line, Interactive, Computer Adaptive Testing Tutorial"</a>. Archived from <a rel="nofollow" class="external text" href="http://edres.org/scripts/cat/catdemo.htm">the original</a> on 11 June 2005. Retrieved 15 April 2005.</cite></li>

<li><cite class="citation journal cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20220315155637/https://www.eojas.in/2021/03/Computer-Based-Test.html">"Special issue: An introduction to multistage testing"</a>. Applied Measurement in Education. 19 (3). Archived from <a rel="nofollow" class="external text" href="https://www.eojas.in/2021/03/Computer-Based-Test.html">the original</a> on 15 March 2022.</cite></li>

<li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20211204083929/https://www.ericdigests.org/pre-9213/tests.htm">"Computerized Adaptive Tests"</a>. Washington, DC: <a href="Education_Resources_Information_Center" title="Education Resources Information Center">Education Resources Information Center</a> Clearinghouse on Tests Measurement and Evaluation. Archived from <a rel="nofollow" class="external text" href="http://www.ericdigests.org/pre-9213/tests.htm">the original</a> on 4 December 2021.</cite></li></ul></div><div><div class="zim-footer">

This article is issued from <a class="external text" title="Last edited on 2025-08-02" href="https://en.wikipedia.org/wiki/?title=Computerized_adaptive_testing&oldid=1303832172">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.

</div>

</div></div>

</div>

</main>

</div>

</body></html>